منابع مشابه
Learning to Forget: Continual Prediction with LSTM
Long short-term memory (LSTM; Hochreiter & Schmidhuber, 1997) can solve numerous tasks not solvable by previous learning algorithms for recurrent neural networks (RNNs). We identify a weakness of LSTM networks processing continual input streams that are not a priori segmented into subsequences with explicitly marked ends at which the network's internal state could be reset. Without resets, the ...
متن کاملLearning to Forget? Contagion and Political Risk in Brazil
We examine whether Brazilian sovereign spreads of over 20 percent in 2002 could be due to contagion from Argentina or to domestic politics, or both. Treating unilateral debt restructuring as a policy variable gives rise to the possibility of self-fulfilling crisis, which can be triggered by contagion. We explore an alternative political-economy explanation of panic in financial markets inspired...
متن کاملMemory Aware Synapses: Learning what (not) to forget
Humans can learn in a continuous manner. Old rarely utilized knowledge can be overwritten by new incoming information while important, frequently used knowledge is prevented from being erased. In artificial learning systems, lifelong learning so far has focused mainly on accumulating knowledge over tasks and overcoming catastrophic forgetting. In this paper, we argue that, given the limited mod...
متن کاملGated Orthogonal Recurrent Units: On Learning to Forget
We present a novel recurrent neural network (RNN) architecture that combines the remembering ability of unitary RNNs with the ability of gated RNNs to effectively forget redundant information in the input sequence. We achieve this by extending Unitary RNNs with a gating mechanism. Our model is able to outperform LSTMs, GRUs and Unitary RNNs on different benchmark tasks, as the ability to simult...
متن کاملFailing to Forget
Most people have experienced distressing events that they would rather forget. Although memories of such events become less intrusive with time for the majority of people, those with posttraumatic stress disorder (PTSD) are afflicted by vivid, recurrent memories of their trauma. Often triggered by reminders in the daily environment, these memories can cause severe distress and impairment. We pr...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Nature Reviews Neuroscience
سال: 2013
ISSN: 1471-003X,1471-0048
DOI: 10.1038/nrn3474